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fae in order to see the finer details. This research effort proposes an improved 


iiidive Newiieaions lighting reflection model-based technique for improving extremely dim images. 

Tophat Transform; This improved method relies on reconstruction carried out via morphological 

Color Space Conversion; processing with Top-hat transformation and Contrast Limited Adaptive His- 

Image Fusion togram Equalization (CLAHE). The HSV colour scheme is used to perceive 
the image, and the V component is estimated. The inverse of the intensity 
component (V) is calculated after normalising the intensity component. The 
negative image is then subjected to the CLAHE algorithm. The final step is 
to apply multiscale image enhancement to the obtained image. The brightness 
component of an image is adaptively adjusted via gamma enhancement. The 
outcomes of two gamma-enhanced photographs with various gamma values 
are produced after gamma enhancement. The significant information that can 
be used for image fusion is extracted from these images using principal com- 
ponent analysis. The weight value is adaptively determined during the PCA- 
based image fusion employing morphological Top-hat modification to enhance 
the image quality and highlight the erratic background pixels. The suggested 
technique emphasises edge and structural preservation while enhancing detail 
in extremely dim photos. Results from experimental validations demonstrate 
that the suggested strategy outperforms the current method in terms of both 
qualitative and quantitative measures. 


1. Introduction tems, intelligent transportation, and the tracking 
The majority of important information can be under- of moving objects. The photographs captured are 
stood through visual data or visual images. They marred by several flaws brought on by a variety 
correlate to the largest amount of collected or per- of unpredictable circumstances, like lighting inside, 
ceived processed information that the human brain evening lighting, and gloomy weather. In these 
is capable of realising. Systems for image pro- circumstances, noise makes colour unrecognisable 


and the tangent surface’s reflection faint. By cre- 


cessing are widely employed in a variety of fields, 
ating content blur and detail loss in dark areas, it 


including biomedical imaging, driver assistance sys- 
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consequently has a significant negative impact on 
the image quality (Guo, Li, and Ling). Low-light 
photos contain a compressed dynamic variation of 
the scene that can be upgraded to disclose hid- 
den data. Compared to the original low illumina- 
tion photos, the dark pixel values produced by the 
suggested method are brighter. One of the diffi- 
cult study fields, poorly illuminated image enhance- 
ment or dark picture enhancement, has applications 
in forensics, night vision, and underwater enhance- 
ment. The brightness values in the extremely dark 
photos are uneven, which greatly lowers the image 
quality. The other difficulties include dealing with 
the noise during the intensification of the compo- 
nent. The proposed approach aims to enhance and 
improve the perception of extremely dim and dark 
images. The structure of the research paper is as 
follows. The literature and current work related to 
low and weak illumination images are briefly intro- 
duced in the second section. The third section out- 
lines the main steps of the methodology suggested in 
this study, along with a thorough description of each 
module’s role in the task. The experimental findings 
are in-depth examined and quantitatively and quali- 
tatively assessed in section 4. Section 5 presents and 
summarises the conclusion. 


2. Related Work 


The CLAHE method, linear contrast adjustment, 
wiener filter noise removal, and other known meth- 
ods are some of the different strategies for low light 
enhancement. A work based on picture contrast, 
colour improvement using adaptive gamma correc- 
tion, and histogram equalisation was proposed by 
the author Veluchamy et al. (Veluchamy and Sub- 
ramani). Although histogram equalisation is used 
to improve digital photos, in most circumstances 
it leads to saturation and over-illumination. The 
approach is based on the histogram distribution 
method and adaptive gamma correction for improv- 
ing contrast. The contrast can be enhanced and 
adjusted using an adaptive gamma correction. The 
work’s given weighted histogram distribution pre- 
serves colour and delivers precise details. Using 
the Gaussian feature, Yuen Peng Loh et al. (Loh, 
Liang, and Chan) discuss a CNN-based work on 
dark and weakly light image improvement. The sci- 
entists also presented a new model as a localised 
function based on Gaussian smoothing for enhanc- 


ing the less lit photos. To comprehend the rela- 
tionship between the pixels, the convolution neural 
network learns the brightness distribution of dark 
images. This method’s primary flaw is overresult, 
which happens as a result of noise problems with 
camera sensors that occur when taking low-light 
pictures. A work on low light enhancement based 
on Guided Image Filtering in Gradient Domain was 
discussed by Xiankun Sun et al. in (Sun et al.). This 
method, which uses a guided image filter to retrieve 
the illumination component of the image, is based 
on the illumination reflection model. With the use 
of edge-aware restrictions in the gradient domain, 
this approach produces results with amazing edge 
preservation and details. 


3. Proposed Work 


A more effective technique for improving the struc- 
ture reconstruction with Top-hat transformation and 
histogram equalisation (CLAHE)-based extremely 
dark image boosting or enhancement is suggested. 
The process is shown in fig. 1 


3.1. Conversion from RGB to 
Hue-Saturation-Value color model 


Brightness can be perceived by the human eye 
instead of colour. To maintain superior outcomes, 
the illuminance correction is carried out. It is impos- 
sible to guarantee that all channels are boosted in the 
proper ratio, which frequently results in distortion of 
the image colour after the correction process. There- 
fore, the illuminance correction must be conducted 
directly on RGB channels. All the hue, saturation, 
and intensity components are independent when a 
picture is transformed to the HSV model. Therefore, 
altering the intensity levels has no direct effect on 
the photographs’ colour (Wang et al.). For this rea- 
son, the RGB colour model of the image is changed 
into the HSV colour model. The hue J), (x, y), sat- 
uration I, (x,y) value I, (x,y) components of the 
image is computed and displayed in fig. 2. 


3.2. Enhancement/ Improvement of illuminance 
component 

3.2.1. Perform Normalization in intensity component 

The process of normalisation modifies the pixel 
intensity levels. 0 to 1 double precision (or single 
precision) numbers can be used to represent images. 
The intensity component’s value in the suggested 
work varies from 0 to 255. As a result, keep the 
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3.2.3. Contrast Limited Adaptive Histogram Equalization 
(CLAHE 

CLAHE (Bai and Zhou), a_ histogram-based 
image enhancement technique, restricts amplifica- 
tion based on the histogram’s clipping to a maxi- 
mum level. The inverse of the intensity image is 
improved in the proposed study using the CLAHE 
approach. When CLAHE is applied to a nega- 
tive image, the visual aspects of the image are 
enhanced, and the enhanced image has more details. 
The resulting image, as shown in Figure 3, is the 
inverse of the normalised intensity component after 
applying contrast-limited adaptive histogram equal- 


isation. 
= La nv 7 


FIGURE 6. Example of CLAHE applied to the 
inverse of intensity image. 


3.3. Gamma Enhancement 


As demonstrated in Figs. 4 and 5, the illumina- 
tion value of overlit areas will drop and the illu- 
mination value of underlit areas will rise. Gamma 
enhancement is carried out based on the empirically 
determined gamma value, which has been deter- 
mined to be between | and 5. The usual image 
is produced when gamma enhancement is applied 
with gamma value |. The gamma output value can 
be increased to make an image appear brighter or 
more enhanced. Here, we conveniently utilise the 
gamma value of 5. Gamma identifies the contour 
of the curve that depicts how the input and output 
images are related. The power law equation is used 
to numerically express the gamma enhancement. 


ve (2) 


where V is the enhanced output image, U indicates 
the input image and the value y is denoted as gamma 
value. 


3.4. Morphological Top-hat transform 

By utilising morphological Top-hat modification, an 
extremely dark image with an uneven distribution 
of intensity values can be efficiently corrected. For 
example, gamma enhancement with a gamma value 
of 1 results in a normal image, whereas gamma 
enhancement with a gamma value of 5 results in 
a darker image. The image with unequal lighting 
components is the fused output image. The sug- 
gested method fixes this issue by introducing a tech- 
nique known as the morphological Top-hat trans- 
form, which may be utilised to improve contrast 
in low-light images by adaptively computing the 
weight values in PCA fusion. A disc structuring ele- 
ment with a radius of three is used to conduct the 
top-hat transform (Pavan and Somashekara). The 
weight value for the PCA fusion is calculated using 
this resultant value. 


FIGURE 8. Enhanced image with gamma value 
1 


CLAHE enhancement and gamma _ enhanced 
images with multiscale gamma values. 
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FIGURE 9. Enhanced image with gamma value 
5 


3.5. Image fusion 


The fused images just calculate the weighted sum of 
the source image i.e. 


where F - fused result image, w; - weight coef- 
ficient and S;- image to be fused. Image fusion 
is done with Principal Component Analysis (PCA) 
algorithm (Wang et al.) is used to determine weight- 
ing coefficients. 

The picture fusion process is carried out accord- 
ing to (Wang et al.). The output of a gamma- 
enhanced image having a gamma value of one and 
the output of a gamma-enhanced image with a 
gamma value of five are combined in the suggested 
method to get the desired result. 


3.6. Inverse image fusion 


As shown in Fig 6 and Fig 7, after the fused image is 
obtained it is subtracted from one to get the inverse 
value of fused image i.e. 


Fi =1-F (4) 


After performing inverse fusion, the value of V 
component is replaced into F’ the value of inverse 
fusion. 


hea (5) 


3.7. HSV to RGB color space conversion 


The HSV image is converted back to RGB space 
using formula (Gonzalez, Eddins, and Woods). The 
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summary of the proposed dark image enhancement 
algorithm is given as follows. 

Proposed Algorithm 

Step 1: Load dark image I as input. 

Step 2: Convert the image from RGB space to 
HSV color system. 

Step 3: Normalize the intensity component and 
take the inverse of normalized intensity component. 

Step 4: Perform the Contrast Limited Adaptive 
Histogram Equalization (CLAHE) into the Resul- 
tant image obtained from step 3. 

Step 5: Let y=1 and y=5 and obtain the gamma 
enhanced images. 

Step 6: Calculate the weight values with morpho- 
logical Top-hat transform. 

Step 7: Obtain the resultant image after fusion. 

Step 8: Obtain the inverse of the fused image. 

Step 9: Use F’ as the V component to merge H 
and S component from HSV and convert image J 
into RGB. 

Step 10: Output the enhanced color image J. 


4. Results and Discussion 


We put our method to the test on photographs taken 
indoors and at extremely dark times of night in order 
to confirm the performance of the suggested task. 


4.1. Qualitative Analysis 


Experimental findings on a variety of photographs 
demonstrate that the suggested method has a clear 
advantage in maintaining detail and can improve the 
image quality, particularly in the case of extremely 
dark images. Fig. 8 displays some of the exper- 
imental findings. The Exdark dataset is used for 
the experimental analysis. The dataset available in 
github https://github.com/cs-chan/Exclusively-Dark 
-Image-Dataset. 


4.2. Performance metrics 


In order to estimate the efficiency of this method, 
three approaches are used 1.e. BRISQUE (Mittal, 
Moorthy, and Bovik), PIQE and NIQE (Mittal, 
Soundararajan, and Bovik). These techniques are 
used to assess the performances of low illumi- 
nated images by comparing the input image and 
the enhanced image. The lowest values indicate 
the higher perception quality of the images. The 
table 1 shows the average quantitative performance 
of ExDark dataset. The work compare the quanti- 
tative analysis with Wencheng Wang (Wang et al.) 
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FIGURE 10. Image fusion using PCA. 


TABLE 1. Average quantitative performance of ExDark dataset 


Calculate 
Eigen value 
and Eigen 
vector 


Select largest 
Eigen value 


Weight 
coefficient 
distribution 


Fused 
image 


Dataset Current Work Proposed Method 

Nige Pipe Brisque Nige Pipe Brisque 
People 9.8564 99.0072 46.3867 3.9921 30.0680 28.8918 
Dog 9.9864 99.1261 46.2956 4.0097 37.9215 30.0219 
Car 9.9528 99.4420 46.7260 3.4314 35.6315 29.1532 
Cycle 9.4255 98.8730 46.8923 3.7758 37.8515 26.8796 
Bus 3.7698 99.4329 26,9319 3.6729 36.1322 26.5876 
Cup 3.9446 98.4408 33.1276 3.0199 37.4407 29.5414 


FIGURE 12. Image fusion based on PCA. 


.The proposed method shows better quality percep- 
tion than Wencheng Wang (Wang et al.). 


FIGURE 13. (a) bottle image (b) current method 
(c) proposed method. 


FIGURE 14. (a) Boy Image. (b) current method 
(c) proposed method. 


FIGURE 15. (a) Bus image (b) current method 
(c) proposed method. Enhanced images with 
extremely low illumination. 


5. Conclusion 


In this study, we offer a morphological operation- 
based contrast limited adaptive histogram equalisa- 
tion technique for dark image improvement. The 


45 


Pavan A C, Lakshmi S and Somashekara 


intensity component of the RGB image is recov- 
ered from and normalised after it has been trans- 
lated into the HSV colour space. Extremely dark 
pixels make up the intensity component, and as 
the intensity value is increased, pixel sounds are 
added. Therefore, before eliminating the noise, we 
take the inverse of the intensity component. On 
the intensity component’s inverse, the Contrast Lim- 
ited Adaptive Histogram Equalization (CLAHE) is 
used. The image will be improved. Then multiscale 
gamma value gamma enhancement is carried out. 
PCA is used to combine images. To enhance the 
image quality during image fusion, adaptively cal- 
culate the weight value utilising morphological Top- 
hat transformation. Top-hat transform can be used 
to alter inconsistent background lighting. After that, 
the picture fusion’s inverse is calculated. The final 
step is converting the image from the HSV colour 
model back to the RGB colour model. The experi- 
ment findings show that our method can accomplish 
higher edge preservation, detailed enhancement, and 
colour balance throughout the photos when com- 
pared to Wang et al. This technique may be effective 
for applications that enhance extremely dark images 
in real time. 
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